Tests for multivariate normality based on canonical 

correlations 

Mans Thulin^ 



Abstract 

We propose new afBne invariant tests for multivariate normality, based on indepen- 
dence characterizations of the sample moments of the normal distribution. The test 
statistics are obtained using canonical correlations between sets of sample moments, 
generalizing the Lin-Mudholkar test for normality. The tests are compared to some 
popular tests based on Mardia's skewness and kurtosis measures in an extensive 
simulation power study and are found to offer higher power against many of the 
alternatives. 

Keywords: Goodness-of-fit; Kurtosis; Multivariate normality; Skewness; Test for 
normality. 

1 Introduction 



Many classical multivariate statistical methods are based on the assumption that the 
data comes from a multivariate normal distribution. Consequently, the use of such 
methods should be followed by an investigation of the assumption of normality. A 
number of tests for multivariate normality can be found in the literature, but the field 
has not been investigated to the same extent as have tests for univariate normality. 

Let 7 = E(X — fi)^/a^ denote the skewness of a univariate random variable X 
and K = E(X — fi)^/a^ — 3 denote its kurtosis. Both these quantities are for the 
normal distribution but nonzero for many other distributions, and some common tests 
for univariate normality are therefore based on 7 and k. 

Different analog mult ivariate i neasu res of skewness and kurtosis have been proposed, 
perhaps most notably by Mardia ( 1970l ). Said measures have been used for various tests 
for multivariate normality in the last few decades. Some of these tests, in particular the 
tests that use Mardia's skewness and kurtosis measures as test statistics, have proved to 
have high power in many simulation studies ( Henze . 20021 : Mecklin Sz Mundfrom . 2004, 
2OO5I ) and new tests for normality based on mult i variate skewness and ku rtosis continue 
to be published today ( Doornik Sz Hansen . 20081 : Kankainen et al. . 2007 ). 
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In this paper ten new tests for normality, all related to multivariate skewness or 
kurtosis, are proposed. Their common basis is independence characterizations of sample 
moments of the multivariate normal distribution. 

The first five are based on the following well-known characterization: the i.i.d. vari- 
ables Xi, . . . , Xn are normal if and only if the sample mean vector X = (Xi, X2, . . . , Xp)' 
and the sample covariance matrix S are independent. 

When trying to use this characterization for tests for normality, it quickly becomes 
evident that it is difficult to test the independence of these two arrays. It is however, as 
we shall see, possible to study the covariance between the elements of the two arrays in 
a satisfactory manner. 

Thus, assume that Xi, . . . , Xn are i.i.d. p-variate random variables with nonsingular 
covariance matrix S. Let X = {Xi,X2, ■ ■ ■ , Xp)' be the sample mean vector and let 



-^ll -512 

S12 S22 



Sip 

S2p 



Sip S2p • • • Spp 

be the sample covariance matrix with Sij = (n— l)"-*^ Ylk=i(-^k,i — ^i){Xk,i — ^j)- Define 

U = {Sii,Si2, . . . , Sip, S22, S23, • • • , S2p, 5*33, . . . , Sp-i^p, Spp)' 

so that w is a vector containing the q = p{p+ l)/2 distinct elements of S. Now, consider 
the covariance matrix of the vector {X',u')', in the following denoted {X,u): 



Cov((X,w)) 



All A12 
A21 A22 



(1) 



where An = Cov(X), A22 = Cov(w), A21 = A-^2 ^^"^ A12 contains covarianccs of the 
type Cov{Xi, Sjk), i,j,k = l,...,p. We will use this matrix when we construct our tests. 

Our main tool for doing so will be canonical correlations. This multivariate gen- 
eralization of Pearson's correlation coefficient is defined as follows. The first canonical 
correlation between X and u is the largest correlation coefficient between linear combi- 
nations of X and u: 

Xi = max \p{a'X,b'u)\. 

The second canonical correlation A2 is the largest correlation coefficient between linear 
combinations of X and u that are uncorrelated with the linear combinations corre- 
sponding to the first canonical correlation. For the third canonical correlation A3, the 
condition is that the linear combinations should be uncorrelated to the first two canonical 
correlations, and so on. 

The canonical correlations can be obtained in different ways. We will use that 
Af , . . . , Ap are the eigenvalues of the matrix 



^11 



'A10A 



12-'V22 



^21, 



(2) 
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see for instance Mardia et al. ( 19791 ) . 

Similarly to what was done above for the covariance, let 



n 



ijk 



and 



V — {Sill, 5*112, • • • , Spp(^p_i), SpppY , 

a vector of length p + p{p — 1) +p{p — l){p — 2)/6. The five other tests are based on the 
fact that X and v are independent if Xi, . . . , X^ are normal. The covariance matrix of 
{X,v) can be written as 



Cov((X,^)) 



*11 *12 
*21 *22 



(3) 



where = Cov(X), = Cov{v), ^21 = *12 contains covariances of the 

type Cov{Xi,Sjki), i,j,k,l = l,...,p. 

In Section l2.ll we state explicit expressions for the elements of Cov{{X,u)) and 
Cov{{X ,v)) in terms of moments of X = {Xi, . . . , Xp). In Section[3]we reexamine Mar- 
dia's measure of multivariate skewness in the light of the results regarding Cov{(X ,u)) 
and propose new tests for normality, all related to multivariate skewnes s . Th ese can 
be viewed as multivari ate generalizations of th e Z2 modification ( Thulin . 20 id ) of the 
Z2 test introduced by Lin &: Mudholkar ( 198d ). In Section H] we use the expressions 
for Cov{{X ,v)) to construct new tests for normality, related to multivariate kurtosis. 
These, in turn, are gen eralizations of the modification of the Z3 test proposed by 
Mudholkar et all ( 2002 ). The results of a simulation study comparing the new tests 
with tests based on Mardia's skewness and kurtosis measures is presented in Section \5\ 
The text concludes with an appendix containing proofs and tables. 



2 Explicit expressions for the covariances 



2.1 Elements of matrices 

In the following theorems we state explicit expressions for the elements of Cov{{X ,u)) 
and Cov{(X ,v)) in terms of moments of {Xi, . . . , Xp). These covariances can be ob- 
tained by tedious but routine calculations of the r noments inv o lved, that are much simpli- 
fied by the use of tensor notation, as described in iMcCuUaghl (|l987l ). All five covariances 
can be found scatt ered in the l i teratu re, expressed using cumulants: (ip-(l6l) are al l given 
in Section 4.2.3 of iMcCullaghl (Il987l ]. (fTD is found in Problem 4.5 of lMcCullaghl (1 19871 ) 
and dSI) is expression (7) in Kaplan ( 19521 ). 



Theorem 1. Assume that Xi, . . . ,Xn are i.i.d. p-variate random variables with 
E\XiXjXkXi\ < 00 fori,j,k,l = 1,2,... , p. Let Hi^^,„^i^ = E{Xi^-^ii^){Xi^-p,i.^) ■ ■ ■ {Xi^ 
fj-ij. Then, for n>2p + p{p — l)/2 and i, j, k,l = 1,2, ... ,p 
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(i) the elements of An are 



CoY{Xi,Xj) = ^fiij, (4) 



(a) the elements 0/A12 and A21 are 



Cov{Xi,Sjk) = -fiijk (5) 
n 

and 

(in) the elements 0/A22 are 

Cov{Sij,Ski) =—{lJ'ijki - IJ'ijfJ'ki) H — 7 — —r^ilJ'iklJ'ji + IJ'iifJ'jk)- (6) 

Since ^'n = An, we only give the expressions for ^22 and ^'12 in the following theorem. 

Theorem 2. Assume that Xi, . . . are i.i.d. p-variate random variables with 
E\XaX(jX^XsXeXt;\ < 00 /or a, C = 1, 2, ... Let fii^,...,i, = E{Xi^ - iii^){Xi^ - 
1^12) ■ ■ ■ {^is - l^is)- Then, for n > 2p + p{p - 1) + p{p - l){p - 2)/6 and i,j, k, r,s,t = 
1,2,... ,p 

(i) the elements of and ^21 are 
and 

(a) the elements 0/^22 are 

Cov{Sijk, Srst) = —\jkrst + ^ _ ( ^ fJ-irifJ-jkst — ^ fJ-jkfJ-st) + ^ fJ-ijrfJ-kst^ 

6 

n x ^ 

(8) 

where Xijkrst is given below and denotes summation over k distinct permu- 
tations of i,j,k,r,s,t. In particular, in Yl^ f^iri- ■ ■) ihe summation is taken over 
all permutations of i,j,k,r, s,t where i and either of j,k switch places and/or r 
and either of s, t switch places. In Yl^ l^ijrfJ'kst the summation is taken over all 
permutations except HijklJirst- Finally, in Y^ l^jkl-i'st and 

15 3 10 15 

^ijkrst ~ l^ijkrst l^krl^st) / J jJ'ijkf^rst / ^ l^ijl^krl^st 

the sums are taken over all distinct permutations. 
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2.2 Covariances expressed using multivariate moments 



To express the covariances above using matrices of multivariate moments, we will need 
some tools from matrix algebra, namely the Kronec ker product (8), the yec ope rator and 
a commutat ion matrix, all of which are described in lKollo von RosenI (|2005l ). See also 

Koiiol (j2nn8l ^. 

For a p X q matrix A = {aij} and an r x s matrix B, the Kronecker product A S 
is the pr x qs matrix {aijB}, i = 1, . . . ,p, j = 1, . . . ,q. The vec operator stacks the 
columns of a matrix underneath eachother, forming a single vector. If the columns of 
the p X q matrix A are denoted ai, . . . , ttg then vec(A) = (a^, . . . , a'^)' is a vector of 
length pq. 

Let /X be the mean vector and S be the covariance matrix of a random variable X. 
The third central moments of X can be written as the p x p^ matrix 

fh^{X) = e[(X - /x) (X - n)' ®{X- /x)]' 

which contains all third order moments of X. Similarly, all fourth order moments of X 
are found in the symmetric p^ x p^ matrix 

mi{X) = e[(X - - ii)' ®{X- ii){X - fx)' 

which we refer to as the fourth central moment of X. Finally, let Kpp be the p^ x p^ 
commutation matrix, which consists of p^ blocks of size pxp, such that in the zjth block 
all elements equal except for element ji, which equals 1. Thus, for instance, when 
p = 3 the commutation matrix is 
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The third and fourth central moments can now be used to give explicit expression for 
the covariance matrices in Theorem [TJ It turns out that it is helpful to use the vector 



u = vec{S) = {Sii, S 



12, 



I Sip, Si2, S22, S23, ■ ■ ■ , Sp-i^p, S) 



ppl 



instead of u when writing these expressions, bearing in mind that we wish to study the 
canonical correlations between X and u and not the covariance matrices themselves. 
Those canonical correlations are the same as the canonical correlations between X and v. 
To see this, note that for every linear combination a'u there exists a b so that h'v = a'u 
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and therefore, by the definition of canonical correlations, the canonical correlations must 
coincide. 

We partition Cov{{X in the same fashion as ([TJ: 



A 

A: 



»-12 
^22 



By direct computation, it can be seen that 



A?2 



1, 

n 
1 

n 



fhsiX) 



and 



A^2 = - (rfi^iX) - vec(5])vec(S)') + —^—(1 2 + Kpp){S S). 

Although the above expressions provide a nice description of the covariance structure, 
they are of less interest when it comes to computational matters. The fact that u contains 
the same elements more than once means that A22 is singular and thus not invertible. 
Hence, we can't study the matrix A^]^~^Ai2A22~^A2i, but must use ^ instead. Similar, 
but less revealing, expressions can be obtained for ^22 and ^12- The same problem 
occurs in that case, meaning that the partitioning ([3]) is of greater use. 



3 Tests based on X and u 

3.1 Mardia's multivariate skewness measure /3i,p revisited 



Mardia ( 1970l . 19741 ) noted that for univariate random variables, asymptotically p{X, S"^) 



-^7 if K is assumed to be negligible. Based on this, he used Cov((X,tt)) to construct a 

multivariate skewness measure. Studying the canonical correlations between X and u 
he proposed the measure 



p 

2 



i=l 

where Ai, . . . , Ap are the canonical correlations. This expression reduces to 2p{X, S^)^ ~ 
7^ for univariate random variables. 

From the theory of canonical correlations we have that Af , . . . , A^ are the eigenvalues 
of Aii~^Ai2A22~^A2i and thus 

/3i,p = 2tr(Aii-^Ai2A22"^A2i). 

Taking these moments to order Mardia showed that 

/3i,pP:^Ef(X-/x)'S-i(l--/x)'' 
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where X and Y are independent and identical random vectors. The sample counterpart 
of the above expression, 



1 3 

^i-p =^ll ((^^ - ^ys-\Xj - ^) , (9) 

is commonly used as a measure for multivariate skewness and as a test statistic for a 
test for multivariate normality. 



In Section 2.8 of iMcCullaghl (jl987l ) Mardia's approximation of /3i^p is shown to be a 
natural generalization of 7^. It is however not necessarily a good approximation of the 
canonical correlations between X and u. An important assumption underlying Mardia's 
skewness measur e is that the fourth in o ment s of the distribution are negligible. Seeing 
as 7^ — 2 < k ; see bubkov Malakhovl (|l97fil ): this seems like a rather strong condition. 



ThulinI (I2OI0I ) noted that 



p^ = p{X,S^)= ^ 



and used p2 = Z2, the sample moment version of this quantity, as a tes t statistic for a test 



for no rmality, proposing a test that is a modified version of the Z2 test (jLin fc Mudholkarl . 



1980l ). This statistic is similar to the sample skewness 7 (commonly known as \/bi) 



which is often used for univariate tests for normality. The Z2 and 7 tests are both 
clearly sensitive to deviations from normality in the form of skewness, but the Z2 test 
has the additional benefit that it also takes the relationship between the skewness and 
the kurtosis into account. In Thulins's simulation power study, was more powerful 
than 7 against most of the alternatives under study. It is therefore of interest to use 
Mardia's approach without any approximations, so as to include the fourth moments as 
well, in the hope that this will render a more powerful test for normality. The explicit 
expressions for Cov{Xi, Sjk) and Cov{Sij, Ski) given in Theorem [1] allows us to study 
Aii~^Ai2A22^^A2i without approximations and to construct new test statistics. 

It should be noted that differences in index notation complicate the situation some- 
what here. Mardia's skewness is denoted bi^p, with 1 as its index, whereas the univariate 
correlation statistic Z2 has 2 as its index. When generalizing to the multivariate 
setting we will keep the index 2, hoping that it won't be confused with Mardia's kurtosis 
measure 62,p- 

The factor 2 in the expression 

/3i,p = 2tr(Aii-iAi2A22"^A2i) 

makes no real sense if we do not assume negligible fourth moments. We will therefore 
omit it in the following and instead study the quantity 

tr(Aii"^Ai2A22""^A2i). 
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Let Sii, S22, S12 and 6^21 be the sample counterparts of An, A22, A12 and A21, where 
IJ'ii,...,is = '^{^h — ^J'^l)iX^2 — Aij2) • • • (Xi^ — fiij are estimated by the sample moments 



rrii 



n 



n 
k=l 



The test statistic for the new test is 



^2^^^ — triSii ^812822 ^821) 



(10) 



fill 



{ ij f \ 

The null hypothesis of normality is rejected \i Z^^ is sufficiently large. 

-^2?^^ coincides with Z2 from Thulin and is thus equivalent with the | Z'2 \ test 

presented there. Z^^^ is a polynomial of degree 10 in 13 moments and the full formula 
takes up more than two pages. It is however readily computed using a computer, as is 
■^2^^^ for higher p. 

3.2 Other test statistics from the theory for canonical correlations 

Let Y and Z be normal random vectors with 



Cov((l^,Z)) 



5^11 5]i2 
Ti2\ "^22 



partitioned like ([T]). Let Sin, ^22 and S12 = S21 sample covariance matrices 

and uj , . . . ,Up he the eigenvalues of l^n ^^12^22 ^^21- In Section 10.3 of Kshirsagail 
(1 19721 ^ the test statistic of the likelihood ratio test of Hq : 5I12 = versus Hi : S12 7^ 
is shown to be 

dogn(i-z)2). (12) 

1=1 



n i 



Now, let Af > A2 > . . . > Ap be the eigenvalues of >S'ii~^S'i2'S22~^'S'2i- Assuming that 
the necessary moments exist, X and u are asymptotically normal. Although 6^22 and 
^12 are not the usual sample covariance matrices, in the light of p^ . this suggests the 
use of the following statistic for a test for normality: 



(13) 



1=1 



The null hypothesis of normality is rejected if Z^^ is sufficiently small. 

Another quan tity that has been considered for a test of Hq : S12 = 0, for instance 
bv lBartlettJ (|l939l ). is 

APB)_^Jl_^ (14) 
A.- 



1=1 



8 



^2 p^"* is similar to Z^^^ , but weighs the correlation coefficients so that larger coefficients 

become more influential. The null hypothesis should be rejected for large values of Z^^^ . 
Finally, we can consider the statistics 

z(7^)=max(A?,...,A2) = A?, (15) 

and 

z(7'^)=min(A?,...,A^) = A^, (16) 

large values of which imply non-normality. Zg™"^^ seems perhaps like the most natural 
choice for a test statistic, as Ai = implies that all canonical correlations are 0. 

The statistics z'^J'\ z')^^^ , ^(max) are all related to well-known 

statistics from multivariate analysis of variance; they are analogs to the Hotelling-Lawley 
trace, Wilk's A, the Pillai-Bartlett trace and Roy's greatest and small est root , resp ec- 
tively. For p = 1 these statistics are all equivalent to the {Zl^l test from iThulin 



3.3 Theoretical results 

Some fundamental properties of the new test statistics are presented in the following 
theorem. Its proof is given in the Appendix. 

Theorem 3. Assume that X^, . . . , Xn are i.i.d. p-variate random variables fulfilling 
the conditions of Theorem [Jl Then, for n > 2p + p{p — 1) /2 and i, j,k = 1,2, ... ,p 

(i) ^2^^^ Z2^\ Z^^^ ^2™"^^ and 0^ affine invariant, i.e. invariant under 

nonsingular linear transformations AX + b, 

(a) The population canonical correlation Ai = max^ ^ \p{aX , bu)\ = if fiijk = for 
all i,j, k and > if Pijk 7^ for at least one combination of i,j, k, and 

( Hi ) ^2^^^ ' ^2p^ ' ^2p^^ Z2^"'^^ and ^2™"^ converge almost surely to the corresponding 
functions of the population canonical correlations Ai > A2 > . . . > Ap. 

Since the statistics are affine invariant, their distributions are the same for all p- 
variate normal distributions for a given sample size n. These null distributions are easily 
obtained using Monte Carlo simulation. 

Since Ai > Aj for j > 1, Ai = implies that all population canonical correlations are 

0, as is the case for the normal distribution. The tests should therefore not be sensitive 
to distributions with that kind of symmetry. All five statistics are, by (ii) and (iii), 
however consistent against alternatives where fiijk 7^ for at least one combination of 

1, j, k. In particular, they are sensitive to alternatives with skew marginal distributions. 
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4 Tests based on X and v 
4.1 Test statistics 



Mardia (|i97nl . I1974I ) proposed the multivariate kurtosis measure 

/32,p = Ef(X-/x)'S-i(l--/x) 



with sample counterpart 

b2,p = -Yl (i^i - xyS-\Xi - X)) . (17) 
In the univariate setting 



n 
1=1 



p, = pix, ^(X, -Xf)= (18) 



where A = ^ — 15k — 107^ — 15 is the sixth standardized cumulant ( Thulin . 20101 ). In 
a simulation power study he found the test for normality based on p^ = Z'^, the sample 
counterpart of (|18|) . to have a better overall performance than the popular k = 62 = 62,1 
test. 

The ideas used in Section [3] for Cov((X,u)) can also be used for Cov((X,t;)) in an 
analog manner, yielding multivariate generalizations of (jlSp . This leads to five new tests 
for normality, as described below. 

Let Pii, P22, -P12 and P21 be the sample counterparts of ^n, ^22, *12 and 
^21; where the are estimated by the sample moments, as in (jlOp above. Let 

V^i > • • • > V'p be the eigenvalues of Pii^^Pi2P22^^P2i- 

The test statistics for the new tests are 

= tr(Pii-iPi2P22-'P2i) = jZ i'l (19) 



4V = Il(^-^")^ (20) 

i=l 



P 



z. 



(PB) 
3,p 

i=l 



y^^, (21) 

z(7^)=max(V;?,...,V^^)=V;? (22) 

47")=min(V'^,...,V'^)=V^. (23) 

Large values of Z^^^\ Z^^^ ^(max) ^{mm) s mall va l ues of Z^^ imply non- 
normality. All five statistics are equivalent to \Z'^\ from Thulin ( 2O10l ) for p = 1. 



and 







L-V''), 












...,v^^) 
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4.2 Theoretical results 

The following theorem mhiiics Theorem [3] above. Its proof is given in the Appendix. 

Theorem 4. Assume that X^, . . . , are i.i.d. p-variate random variables fulfilling 
the conditions of Theorem \^ Then, for n > 2p + p{p — 1) + p{p — — 2)/6 and 
i,j,k,r,s,t = 1,2, . . . ,p 

(i) Z^^^\ ^3p \ -^3p^^ ^^maa;) ^^mm) affine invariant, i.e. invariant under 
nonsingular linear transformations AX + b, 

(a) The population canonical correlation ipi = max^ fj\p{aX ,bv)\ = if fiirst — 
l^irlJ-st — tJ-istJ-rt — fJ-itfJ-rs = for all i, r, s , t = 1, . . . , p and > otherwise, and 

(Hi) Z^^^\ ^3p^ ' ■^3^^^ ^'^'^ ^(rnax) ^g^y^,j,g^ almost surcly to the corresponding func- 
tions of the population canonical correlations ipi > ip2 ^ ■ ■ ■ ^ i^p- 

Using the affine invariance, the null distributions of the statistics can be obtained 
through Monte Carlo simulation. 

By (ii) and (iii) all five statistics are consistent against alternatives where //jrst — 
IJ-irlJ-st — l^isl^rt — IJ'itlJ'rs / for at Icast One combination of i, r, s, t. 



5 Simulation results 
5.1 The simulation study 

To evaluate the performance of the new Z2^p and Z^^p tests, a Monte Carlo study of 
their power was carried out. The tests were compared to the test based on Mardia's 
skewness measure bi^p ([9]), th e test based on Mardia 's kurtosis measure 62,^ ([13) and the 
Mardia-Kent omnibus test T ( Mardia fc Kent . 199ll ). in which the skewness and kurtosis 



measures are combined. The tests were compared for n = 20 and n = 50 for p = 2 and 
p = 3. 

In many power studies for multivariate tests for normality alternatives with indepen- 
dent marginal distributions have been used. We believe that this can be misleading, as 
distributions with independent marginals are uncommon in practice and indeed of little 
interest in the multivariate setting, where the dependence structure of the marginals 
often is paramount. For this reason, we decided to focus mainly on alternatives with 
a more complex dependence structure in our study. One alternative with independent 
exponential marginals, that have been used in many previous power studies, is included 
for reference. 

The alternatives used in the study are presented in Tables [T]|2 l The asymmetri c 



multivariate Laplace distribution mentioned in Table [2] is described in Kotz et al. ( 2000l ). 



In order to see which alternatives that the different tests could be sensitive to, the 
population values of the statistics were determined for all alternatives. For most distribu- 
tions the values were computed numerically, to one decimal place for Mardia's statistics 
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Table 1: Alternatives constructed using their marginals. 



Distr. oiYi 


Construction of (Yi, . . . , Yp) 


Indep. Exp{l) 


Yi,...,Yp i.i.d. Exp{l). 


LogN{0, 2) 


Xo ~ LogN{0,l) indep. of Xi,...,Xp i.i.d. 




LogN{0,l). Yi = Xo-Xp. 


LogN{0, 1) 


Xo ~ LogN{0, 0.5) indep. of Xi,...,Xp i.i.d. 




LogN{0,0.5). Yi = Xq ■ Xp. 


LogN{0,0.5) 


Xo ~ LogN{0, 0.25) indep. of Xi,...,Xp i.i.d. 




LogN{0, 0.25). = Xq • Xp. 


Laplace{0, 1) (type I) 


Xo ~ Exp{l) indep. of Xi,...,Xp i.i.d. 




Exp{l). Yi = Xi- Xo. 


Laplace{0, 1) (type II) 


Xo ~ X(0,1) indep. of Xi,i, Xi,2, Xi,3, i = 




i.i.d. iV(0,l). =Xo-Xi,i+Xi,2-Xi,3. 


Beta{l,l) 


Xo~r(l,l) indep. of Xi, Xp i.i.d. r(l,l). 




Yi = X,/{Xi + Xo). 


Beta{l,2) 


Xo~r(2,l) indep. of Xi, Xp i.i.d. r(l,l). 




= x,/(Xi + Xo). 


Beta{2,2) 


Xo~r(2, 1) indep. of Xi, Xp i.i.d. r(2,l). 




y, = x,/(x, + Xo). 


xl 


Xo ~ r(0.5,0.5) indep. of Xi,...,Xp i.i.d. 




r(o.5,o.5). y^ = Xo + Xi. 


xl 


Xo ~ r(2,0.5) indep. of Xi,...,Xp i.i.d. 




r(2,o.5). y^ = Xo + Xi. 



and to two decimal places for the Z2^p and Z^^p tests. The population values are given 
in Table [3] in the Appendix. 

Using R, the thirteen tests were applied to 1,000,000 samples from each alternative 
and each combination of n and p. The null distributions for all test statistics were 
estimated using 100,000 normal samples. 

5.2 Results and recommendations 

The results from the simulation study are presented in Tables |31l5] in the Appendix. 

Some of the results in the tables highlight the fact that what holds true for one 
combination of p and n can be false for a different combination. For instance, when 
p = 2, Z^""^^ had higher power than bi^p for the AL{1, XIq) and the multivariate xi 

alternatives, but whenp = 3, z^""^^ had lower power than bi^p. This phenomenon merits 
further investigation, as it implies that power studies performed for low values of p can 
be misleading when choosing between tests to use for higher-dimensional data. Similarly, 
when p = 2, hi^p has higher power than ^^^'^^^^ against the LogN{0, 1) distribution when 
n = 20 but lower power when n = 50. 
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Table 2: Purely multivariate 

variances and correlations r. 
Distribution 



alternatives. Here is a covariance matrix with unit 



Description 



t{2) 

AL{l,^o) 
AL(3,Eo) 

^i(l,5]o.5) 

^7V(0, So) + j^A^(l, So) 
^iV(0, So) + ^iV(2, So) 
^iV(0,So) + ^iV(0,So.5) 
^A^(0,So)+ ji5A^(l,So.5) 
^Ar(0, So) + jijiV(2, S0.5) 
|iV(0,So) + iiV(l,So) 
|iV(0,So) + iiV(2,So) 
|iV(0,So) + |iV(0,So.5) 
|Ar(0,So) + |Af(l,So.5) 
fjV(0,So) + iiV(2,So.5) 



Multivariate t distribution, symmetric 

Symmetric multivariate Laplace 

Asymmetric multivariate Laplace 

Asymmetric multivariate Laplace 

Asymmetric multivariate Laplace 

Asymmetric multivariate Laplace 

Location polluted normal mixture 

Location polluted normal mixture 

Rotation polluted normal mixture 

Scale and rotation polluted normal mixture 

Scale and rotation polluted normal mixture 

Heavily location polluted normal mixture 

Heavily location polluted normal mixture 

Heavily rotation polluted normal mixture 

Heavily scale and rotation polluted normal mixture 

Heavily scale and rotation polluted normal mixture 



For p = 2, the ^^'^"^^ had the best overall performance against asymmetric alterna- 
tives, while Mardias skewness test bi^p and the ^2p"^ ^"^^ ^2 tests also displayed a 
good average performance. For p = 3 the performance of ^^'^"^^ was somewhat worse, 

whereas bi^p, z'^^ and Z^^^ still showed good performance. 

Looking at the normal mixtures, which can be viewed as contamined normal distri- 
butions, wc sec that Z^!^^^ and h\^p were on a par for the mildy polluted mixtures (with 

a 9:1 mixing ratio) and that ^2™"^^ in general had higher power for the heavily polluted 

mixtures (with a 3:1 mixing ratio). This suggests the use of the statistic for a 

test for outliers, an idea that perhaps could be investigated further. 

Among the symmetric alternatives, Mardias kurtosis test 62,p and the Za^p tests 
were somewhat surprisingly outperformed by the skewness test and the Z^^p tests for 
some of the alternatives. The Zj,^p were seen to be remarkably insensitive to some 
alternatives, both symmetric and asymmetric, and offered lower power than the Z^^p 
against the (symmetric) multivariate t-distribution. On the other hand, the Za^p tests 
had significantly higher power than the other tests against the symmetric distributions 
with dependent short-tailed Beta{\^\) (uniform) and Beta{2,2) marginals. 

Based on the simulation results, our recommendations are that the ^^'^"^^ test should 

be used against asymmetric alternatives when p = 2. For higher p, 61 p, Z^^ or z'^f^^ 
should be used instead. In general, Mardia's 62,p test should be used against symmetric 
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alternatives. For short-tailed symmetric alternatives, one of the Z^^p tests would be a 
better choice. 
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Appendix: proofs and tables 

For the proof of Theorems [3] and Theorems H] we n eed some basic prop e rties of the 
Kronecker product (g) and vech and vec operators from Henderson Seark ( 19791 ). The 



basics of the Kronecker product and the vec operator were described in Section \2.2[ 
We will use that 

{A(S)B){C(S)D) = AC(S)BD, ( A (g) S)' = A' ® 

and that if A is a p x p matrix and B a q x q matrix, 

det(A t»B) = det(A)« det(A)P. 

The vech operator works as the vec operator, except that it only contains each distinct 
element of the matrix once. For a symmetric matrix A, vech(A) thus contains only the 
diagonal and the elements above the diagonal, whereas vec(A) contains the diagonal 
elements and the off-diagonal elements twice. 

We have the following relationship between the vec operator and the Kronecker 
product: 

vec(ABC) = (C A)vec(B). 

Furthermore, for a given symmetric pxp matrix A there exists a p{p + l)/2 x matrix 
H and a p"^ x p{p + 1) /2 matrix G such that 

vech(A) = i3"vec(A) and vec(A) = Gvech(A). 

As a preparation for the proof of Theorem [3l we prove the following auxiliary lemma. 

Lemma 1. Assume that X,Xi, . . . ,Xn are i.i.d. p-variate random variables fulfilling 
the conditions of Theorem\^ Let Sij = (n — l)^"*^ Sfc=i(^fc,i — Aj)(Afcj — Xj) be the 
elements of the sample covariance matrix S. 

Ux = {Sii,Si2, . . . , Sip, S22, S23, • • • , S2p, S33, . . . , 5'p-i,p, SppY 
is a vector with q = p{p+l) /2 distinct elements. Denote its covariance matrix Cov{ux) = 

A22- 

Let A be a nonsingular p x p matrix and let b be a p-dimensional vector. Then there 
exists a nonsingular q x q matrix D such that 

(i) the sample variances and covariances ofY = AX + h are given by uy = Dux, 
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(ii) Cov(ity) = DA22D' and 

(Hi) det{D) = det(A)P+^ 

Proof. First we note that Ux = vech(S'). 

The transformed sample AX + b has sample covariance matrix ASA', so we wish 
to study vech(AS'A'). We have 

vec{ASA') = {A(g) A)vec{S). 

Moreover, since S is symmetric there exist nonsingular matrices G and H such that 

vec(S') = Gvech(S^) and vech(S') = Hvec{S). 

Thus 

UY = vech(A5A') = H{A A)Gvech(S) =: Dux, 
which establishes the existence of D. From Section 4.2 of Henderson &: Searle ( 19791 ) 



we 



have 

det{D) = det{H{A ® A)G) = det{Ay+^ 

which in nonzero, since A is nonsingular. D is hence also nonsingular. In conclusion, we 
have established the existence and nonsingularity of D as well as (i) and (iii). Finally, 
(ii) follows immediately from (i). □ 

We now have the tools necessary to tackle Theorem [31 



Proof of Theorem\^ (i) From Theorem 10.2.4 in Mardia et al. ( 19791 ) we have that 



the canonical correlations between the random vectors Y and Z are invariant 
under the nonsingular linear transformations AY + b and CZ + d. Clearly all five 
statistics are invariant under changes in location, since Sn, S22, S\2 and S21 all 
share that invariance property. It therefore suffices to show that the nonsingular 
linear transformation AX induces nonsingular linear transformations CX and 
Du. C = A is immediate and the existence of D is given by Lemma [TJ 

(ii) By part (ii) of Theorem [H /Xjjfc = for all i,j,k implies that A12 = 0. But then 
Aii~^Ai2A22^^A2i = and all canonical correlations are 0. If /Xjjfc 7^ then 
p{Xi,Sjk) 7^ 0. Thus the linear combinations a'X = Xi and b'u = Sjk have 
nonzero correlation. Ai must therefore be greater than 0. 

(iii) Follows from the fact that the statistics are continuous function of sample moments 
that converge almost surely. 

□ 

The proofs of parts (ii) and (iii) of Theorem U] are analog to the previous proof. The 
proof for part (i) is however slightly different as we omit to explicitly give a matrix that 
gives a nonsingular linear transformation of vx- 
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Proof of Theorem^ (i). In the spirit of Section \2.2\ let the third order central moment 
of a multivariate random variable Z be 



m3(Z) = E (Z - EZ 



EZ)' (g) (Z - EZ) 



E 



(Z - EZ) (Z - EZ) (Z - EZ) 



Given a sample Xi, . . . ,Xp, let Sjjfc = („_;^)"„_2) I]r=i(-^'-,i--^i)(^r'j--'^j)(Xr,fc-XA:)- 
When the distribution of Z is the empirical distribution of said sample, 



vx — (5'iii, S'ii2, . . . , Spp(^p_i-j,Sppp) 



n 



vechi m?j{Z) 



(n- l)(n-2) 



Similarly vec|^m3(Z) j stacks the elements of m2,{Z) in a vector that simply is vech( •m^{Z) 
with a few repetitions: 



vecf m^{Z) 



wx = (5'iii, S'ii2, • • • , 5'ii2 . . . , Spp(^p_i),Sppp) = _ ^^^^ _ 

Thus, for each linear combination a'wx there exists a 6 so that b'vx = a'wx and 
therefore, by the definition of canonical correlations, the (sample) canonical correlations 
between X and vx are the same as those between X and wx- 
Writing Y = Z - EZ, we have m3(Z) = ¥.{y{Y ® Y)'\ and 



ThsiAZ) = e(^AY{AY (g> AYYj = e(^AY(Y (g> 1^)'(A ® A)' 
= Am3{Z){A(^Ay. 



vec(m3(AZ)) = (A (g A (g) A)vec(m3(Z 



Hence 



Now, det(A (g A A) = det(A ® A)p det(A)P' = det(A)3p' > 0, so E := {A ® A ^ A) 
is a nonsingular matrix such that fh3{AZ) = Efh-i{Z). Since canonical correlations 
are invariant under nonsingular linear transformations of the two sets of variables, this 
means that the canonical correlations between X and wx remain unchanged under the 
transformation AX + b. Thus the canonical correlations between X and vy must also 
necessarily remain unchanged. This proves the affine invariance of the statistics. □ 
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Table 3: Population values of statistics (as n — t- oo) for distributions considered in the study. 
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0.66 


0.36 


0.05 


0.13 


0.87 


0.14 


0.07 


0.03 



Table 4: Power of tests for normality against some alternatives, a = 0.05, p = 2. 



?(min) 



?(min) 



Distribution 



bi, 



t>2,i 



Indep. Exp{l) 



n - 
n - 



20 
50 



0.79 
1.00 



0.54 
0.88 



0.55 
0.86 



0.84 
1.00 



0.86 
1.00 



0.86 
1.00 



0.84 
1.00 



0.72 
1.00 



0.24 

0.41 



0.23 
0.39 



0.20 
0.37 



0.15 
0.30 



0.26 
0.40 



LogN{0, 2) 



n - 
n - 



20 
50 



0.95 
1.00 



0.82 
0.99 



0.82 
0.99 



0.97 
1.00 



0.97 
1.00 



0.97 
1.00 



0.97 
1.00 



0.89 
1.00 



0.50 
0.85 



0.48 
0.84 



0.44 
0.83 



0.36 
0.78 



0.51 
0.82 



LogN{0, 1) 



n : 
n : 



20 
50 



0.38 

0.83 



0.28 
0.56 



0.3 
0.56 



0.29 
0.86 



0.33 
0.86 



0.34 
0.86 



0.35 
0.84 



0.22 
0.7 



0.11 
0.14 



0.10 
0.13 



0.09 
0.11 



0.07 
0.08 



0.12 
0.15 



LogN{0, 0.5) 



n - 
n -- 



20 
50 



0.07 
0.12 



0.06 
0.09 



0.07 

0.09 



0.06 
0.10 



0.06 
0.10 



0.06 
0.10 



0.07 
0.11 



0.06 
0.08 



0.05 
0.05 



0.05 
0.05 



0.05 
0.05 



0.05 
0.05 



0.06 
0.05 



Laplace{0, 1) (type I) 



20 
50 



0.57 
0.92 



0.51 
0.86 



0.44 
0.75 



0.58 
0.92 



0.60 
0.92 



0.60 
0.92 



0.59 
0.91 



0.50 
0.83 



0.06 
0.09 



0.05 
0.08 



0.04 
0.07 



0.03 
0.05 



0.07 
0.12 



Laplace{0, 1) (type II) 



20 
50 



0.37 
0.57 



0.48 
0.84 



0.41 
0.71 



0.25 
0.38 



0.27 
0.39 



0.29 
0.40 



0.30 
0.40 



0.19 
0.24 



0.08 
0.1 



0.07 
0.09 



0.05 
0.07 



0.03 
0.05 



0.09 
0.14 



Beta{l, 1) 



20 
50 



0.02 
0.01 



0.00 
0.00 



0.01 
0.00 



0.05 
0.12 



0.06 
0.12 



0.06 
0.12 



0.06 
0.12 



0.04 
0.09 



0.41 
0.98 



0.43 
0.98 



0.43 
0.98 



0.38 
0.96 



0.34 
0.93 



Beta{l, 2) 



n - 
n - 



20 
50 



0.08 
0.26 



0.03 
0.01 



0.05 
0.02 



0.11 
0.59 



0.13 
0.60 



0.15 
0.62 



0.17 
0.63 



0.08 
0.31 



0.18 
0.40 



0.19 
0.40 



0.19 
0.39 



0.17 

0.35 



0.16 
0.34 



Beta{2, 2) 



n : 
n - 



20 
50 



0.02 
0.02 



0.01 
0.00 



0.01 
0.00 



0.04 
0.08 



0.04 
0.08 



0.04 
0.08 



0.04 
0.07 



0.04 
0.09 



0.14 
0.53 



0.15 
0.52 



0.14 

0.50 



0.13 
0.43 



0.13 
0.46 



n : 
n : 



20 
50 



0.79 
1.00 



0.65 
0.95 



0.64 
0.92 



0.78 
1.00 



0.83 
1.00 



0.84 
1.00 



0.83 
1.00 



0.61 
0.98 



0.24 
0.36 



0.22 
0.35 



0.20 
0.33 



0.15 
0.27 



0.25 
0.34 



20 

50 



0.33 

0.76 



0.25 

0.51 



0.27 

0.50 



0.23 
0.79 



0.27 
0.80 



0.28 
0.80 



0.29 
0.78 



0.17 
0.59 



0.10 

0.11 



0.09 
0.10 



0.08 

0.09 



0.07 

0.07 



0.11 
0.12 



t{2) 



20 
50 



0.72 
0.92 



0.79 
0.99 



0.74 
0.97 



0.57 
0.84 



0.62 
0.85 



0.63 
0.85 



0.64 
0.85 



0.41 
0.61 



0.32 
0.66 



0.31 
0.66 



0.28 
0.65 



0.24 
0.61 



0.31 
0.58 



AL(0,So) 



n - 
n - 



20 
50 



0.42 
0.61 



0.54 
0.89 



0.45 
0.76 



0.27 
0.42 



0.31 
0.43 



0.32 
0.44 



0.33 
0.44 



0.21 
0.27 



0.08 
0.10 



0.07 
0.08 



0.05 
0.07 



0.03 
0.05 



0.1 
0.12 



AL(l,So) 



n - 
n - 



20 
50 



0.67 
0.98 



0.57 
0.90 



0.55 
0.86 



0.57 
0.99 



0.65 
0.99 



0.68 
0.99 



0.69 
0.99 



0.37 
0.79 



0.16 
0.21 



0.15 
0.19 



0.13 
0.18 



0.09 
0.14 



0.18 
0.21 



AL(3,So) 



20 
50 



0.73 
1.00 



0.58 
0.91 



0.58 
0.88 



0.68 
1.00 



0.76 
1.00 



0.78 
1.00 



0.79 
1.00 



0.46 
0.92 



0.19 
0.24 



0.18 
0.23 



0.16 
0.21 



0.12 
0.17 



0.20 
0.24 



ALfl^So.s) 



n = 20 
n = 50 



0.64 
0.97 



0..56 
0.90 



0.54 
0.85 



0.52 
0.97 



0.60 
0.97 



0.63 
0.97 



0.64 
0.97 



0.34 
0.72 



0.15 
0.19 



0.14 
0.18 



0.11 
0.17 



0.08 
O.l:-! 



0.17 
0.21 



AL(l,So.9) 



n - 
n - 



20 
: 50 



0.61 
0.95 



0.57 
0.90 



0.53 
0.85 



0.50 
0.95 



0.60 
0.95 



0.59 
0.96 



0.61 
0.96 



0.33 
0.68 



0.14 
0.19 



0.13 
0.18 



0.11 
0.16 



^JV(0,Eo) + ^iV(l,Eo) 



0.07 
0.13 



0.15 
0.21 



20 

50 



0.06 
0.07 



0.06 
0.07 



0.06 
0.07 



0.05 
0.06 



0.05 
0.06 



0.05 
0.06 



0.06 
0.07 



0.05 
0.06 



0.05 
0.05 



0.05 
0.04 



0.04 
0.04 



^JV(0,Eo) + ^iV(2,Eo) 



0.05 
0.04 



0.05 
0.05 



20 
50 



0.13 
0.33 



0.12 
0.19 



0.12 
0.17 



0.1 
0.27 



0.11 
0.29 



0.12 

0.30 



0.13 
0.33 



0.09 
0.13 



0.05 
0.05 



0.05 
0.04 



0.04 
0.04 



^JV(0,Eo)+ i^iV(0,Eo.5) 



0.04 
0.04 



0.05 
0.05 



n : 
n - 



20 
50 



0.05 
0.06 



0.05 
0.06 



0.06 
0.06 



0.05 
0.05 



0.05 
0.06 



0.05 
0.06 



0.05 
0.06 



0.05 
0.05 



0.05 
0.05 



0.05 
0.04 



0.04 
0.04 



^iV(0,Eo)+ it^iV(l,Eo.5) ^ 



0.05 
0.04 



0.05 
0.05 



20 
50 



0.07 
0.11 



0.07 
0.10 



0.07 
0.10 



0.06 
0.09 



0.06 
0.10 



0.07 
0.10 



0.07 
0.10 



0.06 
0.08 



0.05 
0.05 



0.05 
0.05 



0.04 
0.05 



jAr(0, So) + 3^5^(2,50.5) 



0.05 
0.04 



0.05 
0.06 



n - 
n - 



20 

50 



0.17 

0.43 



0.13 

0.23 



0.14 

0.21 



0.13 

0.36 



0.14 

0.38 



0.15 

0.39 



0.15 

0.40 



0.11 
0.20 



0.06 
0.09 



0.06 

0.08 



0.05 

0.07 



0.05 

0.06 



0.06 
0.10 



n - 
n - 



20 
50 



0.05 
0.06 



0.05 
0.05 



0.05 
0.05 



0.05 
0.06 



0.05 
0.06 



0.05 
0.06 



0.05 
0.06 



0.05 
0.05 



0.05 
0.05 



0.05 
0.05 



0.05 
0.05 



lN{0,So) + TiV(2,So) 



0.05 
0.05 



0.05 
0.05 



20 
50 



0.07 
0.14 



0.05 
0.04 



0.05 
0.04 



0.08 
0.21 



0.08 
0.23 



0.09 

0.24 



0.10 
0.27 



0.07 
0.12 



0.05 
0.06 



0.05 
0.06 



0.05 
0.06 



fA'(O.Eo) + iiVfO.Eo.s) 



0.05 
0.06 



0.05 
0.06 



n = 20 
II = 50 



0.06 

0.07 



0.06 
0.08 



0.06 

0.07 



0.05 
0.()(i 



0.05 
O.Oli 



0.06 

O.Oli 



0.06 

0.0(> 



0.05 
().0() 



0.05 
0.05 



0.05 
0.0 i 



0.01 
0.01 



^iV(0,So)+ iiV(l,So.5) ^ 



0.05 
0.01 



0.05 
0.05 



20 
50 



0.07 
0.13 



0.07 
0.08 



0.07 
0.08 



0.07 
0.14 



0.08 
0.14 



0.08 
0.14 



0.08 
0.13 



0.07 
0.12 



0.05 
0.05 



0.05 
0.05 



0.04 
0.05 



fJV(0,So) + iJV(2,So.5) 



0.05 
0.04 



0.05 
0.06 



20 
50 



0.11 
0.32 



0.06 
0.06 



0.07 
0.06 



0.14 
0.44 



0.15 
0.45 



0.15 
0.45 



0.15 
0.44 



0.14 

0.31 



0.05 
0.07 



0.05 
0.07 



0.05 
0.06 



0.05 
0.06 



0.05 
0.08 



Table 5: Power of tests for normality against some alternatives, a = 0.05, p = 3. 



?(min) 



z{HL) 



, (max) 



?(min) 



Distribution 



bi, 



b2,] 



Indep. Exp{l) 



n - 
n - 



20 
50 



0.82 
1.00 



0.61 
0.93 



0.62 
0.91 



0.84 
1.00 



0.86 
1.00 



0.84 
1.00 



0.77 
1.00 



0.68 
1.00 



0.29 
0.59 



0.29 
0.59 



0.26 
0.57 



0.19 
0.46 



0.26 
0.49 



LogN{0, 2) 



n - 
n - 



20 
50 



0.97 
1.00 



0.89 
1.00 



0.88 
1.00 



0.98 
1.00 



0.98 
1.00 



0.98 
1.00 



0.96 
1.00 



0.88 
1.00 



0.61 
0.95 



0.63 
0.95 



0.62 
0.95 



0.52 
0.90 



0.53 
0.88 



LogN{0, 1) 



n : 
n : 



20 
50 



0.41 
0.89 



0.33 
0.69 



0.36 
0.67 



0.28 
0.87 



0.30 
0.88 



0.30 
0.88 



0.29 
0.84 



0.21 
0.63 



0.13 
0.22 



0.12 
0.21 



0.11 
0.19 



0.08 
0.14 



0.13 
0.21 



LogN{0, 0.5) 



n - 
n -- 



20 
50 



0.07 
0.11 



0.07 

0.09 



0.07 

0.09 



0.06 
0.09 



0.06 
0.09 



0.06 
0.09 



0.06 
0.09 



0.06 
0.08 



0.05 
0.06 



0.05 
0.06 



0.05 
0.06 



0.05 
0.06 



0.05 
0.06 



Laplace{0, 1) (type I) 



20 
50 



0.71 
0.99 



0.61 
0.94 



0.53 
0.86 



0.75 
0.99 



0.76 
1.00 



0.75 
0.99 



0.68 
0.99 



0.59 
0.94 



0.09 
0.24 



0.08 
0.23 



0.06 
0.20 



0.04 
0.12 



0.11 
0.24 



Laplace{0, 1) (type II) 



20 
50 



0.46 
0.72 



0.58 
0.93 



0.49 
0.83 



0.33 
0.51 



0.35 
0.53 



0.35 
0.54 



0.32 
0.52 



0.23 
0.30 



0.09 
0.17 



0.08 
0.16 



0.07 
0.14 



0.05 
0.08 



0.10 
0.16 



Beta{l, 1) 



20 
50 



0.02 
0.02 



0.01 
0.00 



0.02 
0.00 



0.06 
0.15 



0.06 
0.16 



0.06 
0.16 



0.06 
0.16 



0.05 
0.11 



0.28 
0.96 



0.31 
0.97 



0.33 
0.96 



0.28 
0.92 



0.20 
0.85 



Beta{l, 2) 



n - 
n - 



20 
50 



0.08 
0.21 



0.05 
0.02 



0.06 
0.03 



0.09 
0.45 



0.10 
0.49 



0.10 
0.52 



0.11 
0.56 



0.09 
0.20 



0.16 

0.45 



0.16 

0.46 



0.17 

0.46 



0.14 
0.38 



0.13 
0.35 



Beta{2, 2) 



n : 
n - 



20 
50 



0.02 
0.02 



0.01 
0.00 



0.02 
0.01 



0.04 
0.10 



0.05 
0.10 



0.05 
0.09 



0.05 
0.09 



0.04 
0.09 



0.10 
0.40 



0.10 
0.40 



0.11 
0.39 



0.10 

0.32 



0.08 
0.32 



n : 
n : 



20 
50 



0.89 
1.00 



0.79 
0.99 



0.76 
0.97 



0.88 
1.00 



0.90 
1.00 



0.90 
1.00 



0.86 
1.00 



0.72 
0.99 



0.35 
0.71 



0.34 
0.71 



0.32 
0.69 



0.23 
0.56 



0.31 
0.60 



20 

50 



0.39 
0.87 



0.31 

0.62 



0.32 

0.59 



0.31 
0.87 



0.33 
0.88 



0.32 
0.87 



0.29 

0.82 



0.23 

0.68 



0.10 

0.18 



0.09 

0.18 



0.08 
0.16 



0.06 
0.12 



0.10 
0.17 



t{2) 



20 
50 



0.83 
0.98 



0.89 
1.00 



0.85 
0.99 



0.70 
0.95 



0.75 
0.95 



0.76 
0.95 



0.74 
0.95 



0.50 
0.72 



0.34 
0.77 



0.36 
0.77 



0.36 

0.75 



0.32 

0.69 



0.30 
0.69 



AL(0,So) 



n - 
n - 



20 
50 



0.58 
0.80 



0.71 
0.98 



0.60 
0.90 



0.43 
0.61 



0.46 
0.62 



0.46 
0.63 



0.44 
0.62 



0.30 
0.36 



0.10 
0.16 



0.08 
0.14 



0.07 
0.13 



0.04 
0.08 



0.11 
0.15 



AL(l,So) 



n - 
n - 



20 
50 



0.75 
0.99 



0.71 
0.98 



0.68 
0.95 



0.58 
0.99 



0.65 
0.99 



0.67 
0.99 



0.66 
0.99 



0.38 
0.73 



0.24 
0.35 



0.22 
0.34 



0.21 
0.32 



0.15 
0.23 



0.22 
0.29 



AL(3,So) 



20 
50 



0.78 
1.00 



0.71 
0.98 



0.70 
0.96 



0.64 
1.00 



0.72 
1.00 



0.74 
1.00 



0.73 
1.00 



0.41 
0.83 



0.28 
0.39 



0.27 
0.39 



0.26 
0.37 



0.19 
0.28 



0.26 
0.32 



ALfl^So.s) 



n = 20 
n = 50 



0.72 
0.98 



0.71 
0.98 



0.66 
0.91 



0.55 
0.97 



0.61 
0.98 



0.62 
0.98 



0.61 
0.98 



0.,36 
0.()5 



0.20 
0.:-!l 



0.19 

{):■-'>{} 



0.17 
0.27 



0.12 
0.19 



0.20 
0.27 



AL{l,-Eo.9) 



n - 
n - 



20 
: 50 



0.70 
0.98 



0.71 
0.98 



0.66 
0.94 



0.53 
0.95 



0.58 
0.96 



0.60 
0.96 



0.58 
0.96 



0.35 
0.61 



0.19 
0.29 



0.17 
0.28 



0.16 
0.25 



^JV(0,Eo) + ^iV(l,Eo) 



0.11 
0.17 



0.18 
0.25 



20 

50 



0.06 
0.07 



0.06 
0.07 



0.06 
0.07 



0.05 
0.06 



0.05 
0.07 



0.05 
0.07 



0.05 
0.07 



0.05 
0.06 



0.05 
0.05 



0.05 
0.05 



0.05 
0.05 



^JV(0,Eo) + ^iV(2,Eo) 



0.05 
0.05 



0.05 
0.05 



20 
50 



0.15 
0.39 



0.13 

0.21 



0.13 
0.19 



0.11 

0.27 



0.12 

0.32 



0.12 

0.36 



0.12 
0.42 



0.09 
0.12 



0.06 
0.07 



0.06 
0.07 



0.06 
0.07 



^JV(0,Eo)+ i^iV(0,Eo.5) 



0.05 
0.06 



0.06 
0.07 



n : 
n - 



20 
50 



0.05 
0.06 



0.06 
0.07 



0.06 
0.07 



0.05 
0.06 



0.05 
0.06 



0.05 
0.06 



0.05 
0.06 



0.05 
0.06 



0.05 
0.05 



0.05 
0.05 



0.05 
0.05 



^iV(0,Eo)+ it^iV(l,Eo.5) ^ 



0.05 
0.05 



0.05 
0.05 



20 
50 



0.16 
0.15 



0.11 
0.12 



0.11 
0.12 



0.14 
0.11 



0.14 
0.12 



0.14 
0.12 



0.14 
0.12 



0.12 
0.09 



0.05 
0.07 



0.05 
0.07 



0.05 
0.06 



jAr(0, So) + 3^5^(2,50.5) 



0.05 
0.05 



0.06 
0.07 



n - 
n - 



20 

50 



0.74 
0.54 



0.32 

0.25 



0.27 

0.25 



0.68 

0.40 



0.69 

0.44 



0.70 

0.48 



0.71 
0.51 



0.30 
0.16 



0.14 
0.14 



0.13 
0.14 



0.12 

0.13 



0.09 

0.09 



0.18 
0.13 



n - 
n - 



20 
50 



0.05 
0.05 



0.05 
0.05 



0.05 
0.05 



0.05 
0.06 



0.05 
0.06 



0.05 
0.06 



0.05 
0.06 



0.05 
0.06 



0.05 
0.05 



0.05 
0.05 



0.05 
0.05 



lN{0,So) + TiV(2,So) 



0.05 
0.05 



0.05 
0.05 



20 
50 



0.07 

0.12 



0.05 
0.04 



0.05 
0.04 



0.09 

0.21 



0.09 

0.24 



0.09 

0.27 



0.09 
0.32 



0.08 

0.11 



0.06 
0.06 



0.06 
0.06 



0.06 
0.06 



0.06 
0.06 



0.05 
0.06 



n = 20 
II = 50 



0.06 
0.08 



0.07 
0.09 



0.07 
0.09 



0.06 
O.Oli 



0.06 
0.07 



0.06 
0.07 



0.06 
0.0(> 



0.06 
().0() 



0.05 
O.O.") 



0.05 
O.O.j 



0.05 
0.05 



^iV(0,So)+ iiV(l,So.5) ^ 



0.05 
0.05 



0.05 
0.05 



20 
50 



0.08 

0.18 



0.07 
0.10 



0.07 
0.09 



0.09 
0.19 



0.08 
0.19 



0.08 
0.20 



0.08 

0.17 



0.08 

0.14 



0.05 
0.06 



0.05 
0.06 



0.05 
0.06 



fJV(0,So) + iJV(2,So.5) 



0.05 
0.05 



0.05 
0.07 



20 
50 



0.11 
0.35 



0.07 
0.06 



0.07 
0.06 



0.15 

0.51 



0.15 

0.54 



0.15 
0.57 



0.13 
0.56 



0.13 
0.25 



0.06 
0.08 



0.06 
0.08 



0.06 
0.08 



0.06 
0.07 



0.06 
0.08 
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